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Smart  SensorWeb 


emphasizes  large  arrays  of 
local  sensors  joined  with  other 
assets:  imagery,  weather, 
weapons,  simulations,  etc. . . 


Vision:  An  intelligent,  web-centric  distribution  and  fusion 
of  sensor  information  . . .  that  provides  greatly  enhanced 
situational  awareness,  on  demand,  to  Warfighters 
at  lower  echelons. 


Unprecedented  Advances  in 
Commercial  Technologies 


•  Mobile  wireless  networks 

•  Micro  computers 

•  Tele-presence 

•  Geo-location  and  tracking  devices 


•  Wireless  internet  connectivity 

•  Virtual  reality  (entertainment, 
video  games,  immersive 
interaction) 


Relevant  DoD  S&T 


DARPA 

-  Sensor  Progams 

•  VS  AM 

•  AVS 

•  SensIT 

-  Knowledge-Base  Programs 

•  Dynamic  Databases 

•  Command  Post  of  the  Future 

•  Warfighter  Visualization 

•  Intelligent  Integration  of  Information 
Technology 

•  Rapid  Knowledge  Formation 

-  Comm  Network  Programs 
Service  Programs 

-l  ACTDs:  MOUT,  ELB,  JISR,  FMP 


DUSD(S&T)  Initiatives 

-  Cognitive  Readiness,  ATR,  etc. 

DMSO 

-  HLA 

-  Environmental  &  HB  Reps 
Basic  Research 

-  MURI 

•  Data  Fusion  in  Large  Array  Mirco- 
sensors 

•  Mobile  Augmented  Battlespace 
Visualization 

•  Real-Time  Fault-Tolerant  Network 
Protocols 

•  Adaptive  Mobile,  Wireless  Networks 
for  Highly  Dynamic  Environments 

-  Basic  Research  Plan  efforts 
Sensors,  algorithms,  environmental 
and  cognitive  modeling,  etc. 


-  Warrior  Extended  Battlespace  Sensors 

-  Multifunction  RF  Sensor  Technology 

-  Cooperative  Engagement  Capability 

-  Battlespace  Infosphere 


Force  Medical  Protection  ACTD 


Phase  I: 

Chemical  Dosimeter 
(Non  Real-time) 


Phase  II: 

Chemical  Dosimeter  (Real-time)/ 
Biological  Dosimeter 
(Non  Real-time) 


Estimated  unit  cost  for  production: 
Between  $10-$100  per  badge 


The  Evolution 


Sensors... 

•  Multi-domain  sensors 

•  Low  cost  and  micro  size 

•  Capable  of  target  ID  (ATR) 

•  Autonomous  &  platform  based 


SensorWeb... 


•  Sensor  arrays 

•  Wireless,  high-bandwidth  communications 

•  Next  Generation  Internet 

•  Efficient  links  to  weapons  and  simulations 


Smart  SensorWeb ... 


•  Adaptive,  intelligent  sensor  arrays 

•  Intelligent  information  management  and  dissemination 
--  Avoids  “information  overload” 

•  Dynamic  databases  and  knowledge-bases 

•  Intelligent  agents  as  mediators 

•  Multi-sensory,  natural  user  interfaces 


Smart  SensorWeb: 
Objectives  (FYOO  -  FY02) 


Identify  Warfighter  requirements  for  SSW 

-  Showcase/illuminate  current  S&T 
products  and  capabilities 


Demonstrate  SSW  technical  feasibility 


Demonstrate  enhanced  situational  awareness 


Assess  utility  to  the  Warfighter 
Identify  future  research  priorities 


SSW  Elements 


•  Image  Web 

-  Adaptive  sensor  arrays 

-  Intelligent  data  fusion 

•  Weather  Web 

-  Nowcasts  &  predictions 

-  Dynamic  weather  effects 

•  Weapons  Web 

-  Sensor-shooter  links 

-  Optimized  engagements 

•  Simulation  Web 

-  Simulation-based  development 

-  Mission  planning,  rehearsal, 

&  training 

•  Information  Integration 

-  Info  fusion  &  visualization 

-  Data  standards 


No  where  to  hide! 


Decision 

Dominance 


•  ImageWeb 

-  ID  sensor  arrays 

-  Add  sensor  arrays 

-  Sensor  alerts 

-  Visualize  data 

-  Obtain  images 


SSW  Concept 


Decision 

Dominance 


•  ImageWeb 

-  ID  sensor  arrays 

-  Add  sensor  arrays 

-  Sensor  alerts 

-  Visualize  data 

-  Obtain  images 

*  WeaponsWeb 

-  Determine  threat 

-  Friendly  situation 

-  Engage  target 

-  Assess  damage 


SSW  Concept 


Decision 

Dominance 


ImageWeb 

-  ID  sensor  arrays 

-  Add  sensor  arrays 

-  Sensor  alerts 

-  Visualize  data 

-  Obtain  images 
WeaponsWeb 

-  Determine  threat 

-  Friendly  situation 

-  Engage  target 

-  Assess  damage 

WeatherWeb 

-  Nowcasts  & 
predictions 

-  Dynamic  effects 


SSW  Concept 


Orders  Fires 
V  Requests  I  Alerts 


Overlays 

Map/SA 

Display 

User 

Admin 

User 

Menu 

Exit 

Decision 

Dominance 


>  ImageWeb 

-  ID  sensor  arrays 

-  Add  sensor  arrays 

-  Sensor  alerts 

-  Visualize  data 

-  Obtain  images 

•  WeaponsWeb 

-  Determine  threat 

-  Friendly  situation 

-  Engage  target 

-  Assess  damage 

►  WeatherWeb 

-  Nowcasts  &  pred. 

-  Dynamic  effects 

•  SimulationWeb 

-  Fly-through 

-  Planning/rehearsal 


Smart  SensorWeb: 
Testbed  Approach 


☆Testbeds  allow  a  near-term  technology  “build-and- 
demonstrate”  that  evolves  to  the  long-term  vision 


☆Four  Key  Testbed  Projects  to  Demonstrate 
Capability: 


Information  Integration  — ►  Decision  Dominance 


♦  Image  Web 

♦  Weather  Web 

♦  Weapons  Web 

♦  Simulation  Web 


Information 

Ring  to  rule  them  all,' 
Ring  to  find  them, 
to  bring  them  all,  and 
darkness  bind  them.” 

JRR  Tolkien,  “Lord  of  the 

ynde/*s\ap3^b§. 


Focus  on  MOUT  Scenario 


Center  for  Army  Lessons  Learned 

-  Majority  of  MOUT  casualties  due  to  inadequate  situational  awareness 

-  Commanders  have  difficulty  “seeing”  the  fight 


Changing  Environments 

Security 

Threats 

21st  Century 

Conflict  Increasing 

Proliferation  of  Military  and 
Commercial  Technologies 

Operations  in  Urban 
Environments 

Preponderance  of  Coalitions 

Ethnic  Strife 

Impact 

Rogue  Nation 
States/Alliances 

Greater  Range  of 
Solutions 

International  Crine 
Organizations 

No  US  Monopoly  in 
all  Technologies 

Transnational  Actors/ 

Terrorists 

Complex  Targets/Terran 

Weapon  s  of 

Mass  Destruction 

Information 
Management  Critical 

Smart  SensorWeb: 

Key  Players 


ImaqeWeb: 

Dr.  Don  Reago,  Army  NVESD 
Ms.  Mun-Won  Fenton,  ONR 
WeatherWeb: 

Dr.  Douglas  Brown,  ARL 
Dr.  John  McCarthy,  NRL,  Monterey 
WeaponsWeb: 

Col  Norman  Leonpacher,  AFRL-Eglin 
Dr.  James  Chew,  ONR 

SimulationWeb: 

Mr.  William  Jarvis,  US  Army  NVESD 
CAPT  Robert  Eberth,  MCWL 
Information  Integration: 

Mr.  John  Graniero,  AFRL 
Mr.  George  Lukes,  DARPA 
Dr.  Lee  Hammarstrom,  NRO 


Smart  SensorWeb: 

Dr.  Jasper  Lupo,  DUSD(S&T)/SS 
Dr.  Charles  Holland,  DUSD(S&T)/IS 
LTC  Bruce  Gwilliam,  DUSD(S&T)/SS 
Mr.  Jeff  Paul,  DUSD(S&T)/SS 
Mr.  Marshall  Potter,  DUSD(S&T)/IS 
CAPT  David  Martin,  DUSD(S&T)/IS 


Image  Web 

Year  1  -  Web  on  Line 


Alerting  icon  queried 
for  imagery 


Point,  click  and  see  in  an  urban  environment: 

•  Priority  alert  to  operator 

•  3-D  visualization 

•  Multiple  sensors 

•IR/EO, 

•acoustic,  & 

•seismic 
•jl-sensors 

•  Internet/LAN  real-time  access 

•  Images  registered  to  site  map 
(Compact  Terrain  Data  Base) 

•  Target  classification 

•  Target  geolocation 

•  Target  tracking 

•  Target  hand-off 


Year  2  -  Image  Web  Assistant 


Building  on  Year  1  to  automate  target  of 
interest  detection/recognition  and  tracking 

•  Data  fusion  between  multiple  viewpoints 

•  Multi-modal  data  fusion  (thermal  /daylight) 

•  Random  sensor  placement  experiments 

•  Weather  Web  integration 

•  Image  to  model  registration 

•  MTI/Change  Detection/Cross-cueing 

•  Sensor  arbitration  for  ‘best  view’ 

•  Geolocation  via  N-camera  registration 

•  Simulation  integration  via  HLA  protocol 


Multi-modal  Data  Fusion 


i 
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Image  to  model  registration 


Year  3  -  Intelligent  Image  Agent 


Smart  Sensor  Webs 

•  Mobile  Ad  Hoc  Network 

•  Air  dropped  sensors 

•  Tactical  mobile  robots 

•  Multi-sensor  coordination 

•  Leveraging  DARPA’s  SUO, 
IU,  DDE,  MEMS  Programs 

•  Novel  sensors 

•  Managed  video/data  streams 

•  Tactical  sensor  integration 

•  4-D  model  -  live  simulation 


Long  Haul  Comms  Nr 
Mobile 

Database 


Long  Haul  Comms  Node 
Unattended 
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Command  Post  T 


WeatherWeb 


Sensor  Models 


Propagation 

Modeling 
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Terrain 
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Configuration 
Communications 
Processing 


Simulated  sensor  data 
Communications  performance 
,  Sensor  energy  expenditure 


Weather 

Sensor  Web 

Forecast 

Simulation 

Simulation 

— - — ► 

Algorithm 

'  W 

T 

Simulation  Uses 

-  System  design 

-  Experiment  planning 

-  Deployment  planning 

-  ConOps  development 

-  Training 


Compare 


User  Display 
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WeaponsWeb 
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Pre-mission  Planning 


Web  portal 


Weapons  Fly-out  Simulation 


Smart  SensorWeb 


Web  portal 


'Imagery 
Weather 


Inter-Weapon 
LAN  Simulation 


RPV  Weapon  Emulation 


LADAR  Automatic  Target 
Recognition  Captive  Flight  Test  Results 


SSW: 

From  Data  to  Understanding 


Column  of  enemy  tanks  is  reconnaissance  element  of  larger  tank  regiment 

•  Hills  provide  the  enemy  cover  from 
friendly  direct  fire  for  next  20  minutes 

•  Indirect  fire  engagement  now  can  halt 
regiment’s  narrow  route  of  advance  until 

FUnder-Vtack  air  arrives 

Enhanced  visualization  of 
the  battlefield 

•  3D  view  of  the  area 

Knowledge  \  •  Tank  is  one  of  three  in  a  column 

•  Friendly  locations 


here  is  a  tank  in  the  image 


An  image  of  a  section  of  a  map 


Managing  SSW  Information 


Approaches  for  Handling  Information 


Specific  Information  Management 
(registered  to  discreet  objects, 
locations,  &  events) 

This  patch  of  ground  is  swampy. 

These  four  vehicles  are  tanks. 

This  building  is  a  military  HQ.  Click  for 
floor  plan. 


Generalized  Information  Management 
(associated  with  classes  of  objects, 
locations,  &  events) 

Low  lying  ground  tends  to  be  swampy. 

Tanks  move  in  platoons  of  four. 

Military  buildings  are  located  at  the  edge  of  the 
town  and  the  headquarters  building  is  the  largest 
in  the  group. 


Summary 


Broad  initiative 

-  Large  arrays  of  local  sensors 

-  Testbed  emphasis  to  prove  concept 

Leverages  DoD  and  commercial 
investments 

Long  term  research  opportunities 


Operational  Decision 
Dominance 


“seeding”  the  battlefield 
with  a  network  of 
distributed  sensors 


